Will Generative AI Tools Improve Access to Reliable Health Information?

This Medical News article is an interview with JAMA Editor in Chief Kirsten Bibbins-Domingo and Virologist Davey Smith, head of the Division of Infectious Diseases and Global Public Health at the University of California, San Diego.

Perceptions of students and faculty on NCAAA-accredited health informatics programs in Saudi Arabia: an evaluative study.

BACKGROUND: As the healthcare sector becomes increasingly reliant on technology, it is crucial for universities to offer bachelor's degrees in health informatics (HI). HI professionals bridge the gap between IT and healthcare, ensuring that technology complements patient care and clinical workflows; they promote enhanced patient outcomes, support clinical research, and uphold data security and privacy standards. This study aims to evaluate accredited HI academic programs in Saudi Arabia. METHODS: This study employed a quantitative, descriptive, cross-sectional design utilising a self-reported electronic questionnaire consisting of predetermined items and response alternatives. Probability-stratified random sampling was also performed. RESULT: The responses rates were 39% (n = 241) for students and 62% (n = 53) for faculty members. While the participants expressed different opinions regarding the eight variables being examined, the faculty members and students generally exhibited a strong level of consensus on many variables. A notable association was observed between facilities and various other characteristics, including student engagement, research activities, admission processes, and curriculum. Similarly, a notable correlation exists between student engagement and the curriculum in connection to research, attrition, the function of faculty members, and academic outcomes. CONCLUSION: While faculty members and students hold similar views about the institution and its offerings, certain areas of divergence highlight the distinct perspectives and priorities of each group. The perception disparity between students and faculty in areas such as admission, faculty roles, and internships sheds light on areas of improvement and alignment for universities.

Designing for caregiving networks: a case study of primary caregivers of children with medical complexity.

OBJECTIVE: The study aimed to characterize the experiences of primary caregivers of children with medical complexity (CMC) in engaging with other members of the child's caregiving network, thereby informing the design of health information technology (IT) for the caregiving network. Caregiving networks include friends, family, community members, and other trusted individuals who provide resources, information, health, or childcare. MATERIALS AND METHODS: We performed a secondary analysis of two qualitative studies. Primary studies conducted semi-structured interviews (n = 50) with family caregivers of CMC. Interviews were held in the Midwest (n = 30) and the mid-Atlantic region (n = 20). Interviews were transcribed verbatim for thematic analysis. Emergent themes were mapped to implications for the design of future health IT. RESULTS: Thematic analysis identified 8 themes characterizing a wide range of primary caregivers' experiences in constructing, managing, and ensuring high-quality care delivery across the caregiving network. DISCUSSION: Findings evidence a critical need to create flexible and customizable tools designed to support hiring/training processes, coordinating daily care across the caregiving network, communicating changing needs and care updates across the caregiving network, and creating contingency plans for instances where caregivers are unavailable to provide care to the CMC. Informaticists should additionally design accessible platforms that allow primary caregivers to connect with and learn from other caregivers while minimizing exposure to sensitive or emotional content as indicated by the user. CONCLUSION: This article contributes to the design of health IT for CMC caregiving networks by uncovering previously underrecognized needs and experiences of CMC primary caregivers and drawing direct connections to design implications.

Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer's disease and related dementias.

BACKGROUND: Alzheimer's disease and related dementias (ADRD) affect over 55 million globally. Current clinical trials suffer from low recruitment rates, a challenge potentially addressable via natural language processing (NLP) technologies for researchers to effectively identify eligible clinical trial participants. OBJECTIVE: This study investigates the sociotechnical feasibility of NLP-driven tools for ADRD research prescreening and analyzes the tools' cognitive complexity's effect on usability to identify cognitive support strategies. METHODS: A randomized experiment was conducted with 60 clinical research staff using three prescreening tools (Criteria2Query, Informatics for Integrating Biology and the Bedside [i2b2], and Leaf). Cognitive task analysis was employed to analyze the usability of each tool using the Health Information Technology Usability Evaluation Scale. Data analysis involved calculating descriptive statistics, interrater agreement via intraclass correlation coefficient, cognitive complexity, and Generalized Estimating Equations models. RESULTS: Leaf scored highest for usability followed by Criteria2Query and i2b2. Cognitive complexity was found to be affected by age, computer literacy, and number of criteria, but was not significantly associated with usability. DISCUSSION: Adopting NLP for ADRD prescreening demands careful task delegation, comprehensive training, precise translation of eligibility criteria, and increased research accessibility. The study highlights the relevance of these factors in enhancing NLP-driven tools' usability and efficacy in clinical research prescreening. CONCLUSION: User-modifiable NLP-driven prescreening tools were favorably received, with system type, evaluation sequence, and user's computer literacy influencing usability more than cognitive complexity. The study emphasizes NLP's potential in improving recruitment for clinical trials, endorsing a mixed-methods approach for future system evaluation and enhancements.

Incorporating ChatGPT in Medical Informatics Education: Mixed Methods Study on Student Perceptions and Experiential Integration Proposals.

BACKGROUND: The integration of artificial intelligence (AI) technologies, such as ChatGPT, in the educational landscape has the potential to enhance the learning experience of medical informatics students and prepare them for using AI in professional settings. The incorporation of AI in classes aims to develop critical thinking by encouraging students to interact with ChatGPT and critically analyze the responses generated by the chatbot. This approach also helps students develop important skills in the field of biomedical and health informatics to enhance their interaction with AI tools. OBJECTIVE: The aim of the study is to explore the perceptions of students regarding the use of ChatGPT as a learning tool in their educational context and provide professors with examples of prompts for incorporating ChatGPT into their teaching and learning activities, thereby enhancing the educational experience for students in medical informatics courses. METHODS: This study used a mixed methods approach to gain insights from students regarding the use of ChatGPT in education. To accomplish this, a structured questionnaire was applied to evaluate students' familiarity with ChatGPT, gauge their perceptions of its use, and understand their attitudes toward its use in academic and learning tasks. Learning outcomes of 2 courses were analyzed to propose ChatGPT's incorporation in master's programs in medicine and medical informatics. RESULTS: The majority of students expressed satisfaction with the use of ChatGPT in education, finding it beneficial for various purposes, including generating academic content, brainstorming ideas, and rewriting text. While some participants raised concerns about potential biases and the need for informed use, the overall perception was positive. Additionally, the study proposed integrating ChatGPT into 2 specific courses in the master's programs in medicine and medical informatics. The incorporation of ChatGPT was envisioned to enhance student learning experiences and assist in project planning, programming code generation, examination preparation, workflow exploration, and technical interview preparation, thus advancing medical informatics education. In medical teaching, it will be used as an assistant for simplifying the explanation of concepts and solving complex problems, as well as for generating clinical narratives and patient simulators. CONCLUSIONS: The study's valuable insights into medical faculty students' perspectives and integration proposals for ChatGPT serve as an informative guide for professors aiming to enhance medical informatics education. The research delves into the potential of ChatGPT, emphasizes the necessity of collaboration in academic environments, identifies subject areas with discernible benefits, and underscores its transformative role in fostering innovative and engaging learning experiences. The envisaged proposals hold promise in empowering future health care professionals to work in the rapidly evolving era of digital health care.

Conceptual design of a generic data harmonization process for OMOP common data model.

BACKGROUND: To gain insight into the real-life care of patients in the healthcare system, data from hospital information systems and insurance systems are required. Consequently, linking clinical data with claims data is necessary. To ensure their syntactic and semantic interoperability, the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) from the Observational Health Data Sciences and Informatics (OHDSI) community was chosen. However, there is no detailed guide that would allow researchers to follow a generic process for data harmonization, i.e. the transformation of local source data into the standardized OMOP CDM format. Thus, the aim of this paper is to conceptualize a generic data harmonization process for OMOP CDM. METHODS: For this purpose, we conducted a literature review focusing on publications that address the harmonization of clinical or claims data in OMOP CDM. Subsequently, the process steps used and their chronological order as well as applied OHDSI tools were extracted for each included publication. The results were then compared to derive a generic sequence of the process steps. RESULTS: From 23 publications included, a generic data harmonization process for OMOP CDM was conceptualized, consisting of nine process steps: dataset specification, data profiling, vocabulary identification, coverage analysis of vocabularies, semantic mapping, structural mapping, extract-transform-load-process, qualitative and quantitative data quality analysis. Furthermore, we identified seven OHDSI tools which supported five of the process steps. CONCLUSIONS: The generic data harmonization process can be used as a step-by-step guide to assist other researchers in harmonizing source data in OMOP CDM.

Towards global model generalizability: independent cross-site feature evaluation for patient-level risk prediction models using the OHDSI network.

BACKGROUND: Predictive models show promise in healthcare, but their successful deployment is challenging due to limited generalizability. Current external validation often focuses on model performance with restricted feature use from the original training data, lacking insights into their suitability at external sites. Our study introduces an innovative methodology for evaluating features during both the development phase and the validation, focusing on creating and validating predictive models for post-surgery patient outcomes with improved generalizability. METHODS: Electronic health records (EHRs) from 4 countries (United States, United Kingdom, Finland, and Korea) were mapped to the OMOP Common Data Model (CDM), 2008-2019. Machine learning (ML) models were developed to predict post-surgery prolonged opioid use (POU) risks using data collected 6 months before surgery. Both local and cross-site feature selection methods were applied in the development and external validation datasets. Models were developed using Observational Health Data Sciences and Informatics (OHDSI) tools and validated on separate patient cohorts. RESULTS: Model development included 41 929 patients, 14.6% with POU. The external validation included 31 932 (UK), 23 100 (US), 7295 (Korea), and 3934 (Finland) patients with POU of 44.2%, 22.0%, 15.8%, and 21.8%, respectively. The top-performing model, Lasso logistic regression, achieved an area under the receiver operating characteristic curve (AUROC) of 0.75 during local validation and 0.69 (SD = 0.02) (averaged) in external validation. Models trained with cross-site feature selection significantly outperformed those using only features from the development site through external validation (P < .05). CONCLUSIONS: Using EHRs across four countries mapped to the OMOP CDM, we developed generalizable predictive models for POU. Our approach demonstrates the significant impact of cross-site feature selection in improving model performance, underscoring the importance of incorporating diverse feature sets from various clinical settings to enhance the generalizability and utility of predictive healthcare models.

Job search strategies and early careers of clinical informatics fellowship alumni (2016-2022).

OBJECTIVE: To report on clinical informatics (CI) fellows' job search and early careers. MATERIALS AND METHODS: In the summer of 2022, we performed a voluntary and anonymous survey of 242 known clinical informatics fellowship alumni from 2016 to 2022. The survey included questions about their initial job search process; first job, salary, and informatics time after training; and early career progression over the first 1-6 years after fellowship. RESULTS: Nearly half (101, 41.7%) responded to the survey. Median informatics time was 50%; most were compensated similar/better than a purely clinical position. Most reported CI fellowship significantly impacted their career, were satisfied with their first and current job after training, and provided advice for current fellows and CI education leaders. Graduates in 2022 had a median job search of 5 months, beginning 3-15 months before graduation; most had a position created for them. Nearly all graduates from 2016-2021 (61, 93.8%) had at least one change in roles/benefits since finishing training, with a trend for increased informatics time and salary. DISCUSSION: There was a wide variety of roles, salary, and funding sources for CI positions. This highlights some of the unique challenges CI fellows face and the importance of networking. These results will help CI education leaders, fellows, alumni, and prospective fellowship applicants. CONCLUSION: Graduates felt that CI fellowship had a significant impact on their career, were pleased with their first jobs and early career trajectory. Continued follow-up of the experience of new graduates and alumni is needed to assess emerging patterns over time.

Comparing "Meaningful Use" of Health Information Technology in Pennsylvania: Electronic Prescription Rates of Metropolitan and Rural Counties.

The Health Information Technology for Economic and Clinical Health Act incentivized the adoption of electronic health records (EHRs). Health systems looked to leverage technology to assist in serving populations in health professional shortage areas. Qualitative research points to EHR usability as a source of health inequities in rural settings, making the challenges of EHR usage a subject of interest. Pennsylvania offers a model for investigating rural health infrastructure with it having the third largest rural population in the United States. This study analyzed the adoption of Electronic Prescribing in the 67 Pennsylvania (PA) counties. Physician adoption and usage data for PA and the United States were compared using a t-test to establish a basis for comparison. PA counties were categorized using the United States Department of Agriculture (USDA)'s Rural-Urban Commuting Areas (RUCAs) system. Surescript use percentages were plotted against the RUCA scores of each PA county to create a polynomial regression model. PA office-based physicians, on average, utilize e-prescription tools at the same rate as the national average with 59% of practices utilizing Surescripts as of 2013. There was no significant correlation between Surescript usage and the rural/urban classification of counties in Pennsylvania (R-squared value of 0.06). Pennsylvania was able to adopt health information technology (HIT) infrastructure at the same rate as the national average. Rural and metropolitan definitions do not correlate to meaningful use of HIT, thus usability of HIT cannot be tied to health outcomes. Future studies looking at specific forms of HIT and their ability to decrease the burden of administrative work for clinicians.

Public Health Informatics and the Perioperative Physician: Looking to the Future.

The role of informatics in public health has increased over the past few decades, and the coronavirus disease 2019 (COVID-19) pandemic has underscored the critical importance of aggregated, multicenter, high-quality, near-real-time data to inform decision-making by physicians, hospital systems, and governments. Given the impact of the pandemic on perioperative and critical care services (eg, elective procedure delays; information sharing related to interventions in critically ill patients; regional bed-management under crisis conditions), anesthesiologists must recognize and advocate for improved informatic frameworks in their local environments. Most anesthesiologists receive little formal training in public health informatics (PHI) during clinical residency or through continuing medical education. The COVID-19 pandemic demonstrated that this knowledge gap represents a missed opportunity for our specialty to participate in informatics-related, public health-oriented clinical care and policy decision-making. This article briefly outlines the background of PHI, its relevance to perioperative care, and conceives intersections with PHI that could evolve over the next quarter century.

A national survey of digital health company experiences with electronic health record application programming interfaces.

OBJECTIVES: This study sought to capture current digital health company experiences integrating with electronic health records (EHRs), given new federally regulated standards-based application programming interface (API) policies. MATERIALS AND METHODS: We developed and fielded a survey among companies that develop solutions enabling human interaction with an EHR API. The survey was developed by the University of California San Francisco in collaboration with the Office of the National Coordinator for Health Information Technology, the California Health Care Foundation, and ScaleHealth. The instrument contained questions pertaining to experiences with API integrations, barriers faced during API integrations, and API-relevant policy efforts. RESULTS: About 73% of companies reported current or previous use of a standards-based EHR API in production. About 57% of respondents indicated using both standards-based and proprietary APIs to integrate with an EHR, and 24% worked about equally with both APIs. Most companies reported use of the Fast Healthcare Interoperability Resources standard. Companies reported that standards-based APIs required on average less burden than proprietary APIs to establish and maintain. However, companies face barriers to adopting standards-based APIs, including high fees, lack of realistic clinical testing data, and lack of data elements of interest or value. DISCUSSION: The industry is moving toward the use of standardized APIs to streamline data exchange, with a majority of digital health companies using standards-based APIs to integrate with EHRs. However, barriers persist. CONCLUSION: A large portion of digital health companies use standards-based APIs to interoperate with EHRs. Continuing to improve the resources for digital health companies to find, test, connect, and use these APIs "without special effort" will be crucial to ensure future technology robustness and durability.

BactInt: A domain driven transfer learning approach for extracting inter-bacterial associations from biomedical text.

BACKGROUND: The healthy as well as dysbiotic state of an ecosystem like human body is known to be influenced not only by the presence of the bacterial groups in it, but also with respect to the associations within themselves. Evidence reported in biomedical text serves as a reliable source for identifying and ascertaining such inter bacterial associations. However, the complexity of the reported text as well as the ever-increasing volume of information necessitates development of methods for automated and accurate extraction of such knowledge. METHODS: A BioBERT (biomedical domain specific language model) based information extraction model for bacterial associations is presented that utilizes learning patterns from other publicly available datasets. Additionally, a specialized sentence corpus has been developed to significantly improve the prediction accuracy of the 'transfer learned' model using a fine-tuning approach. RESULTS: The final model was seen to outperform all other variations (non-transfer learned and non-fine-tuned models) as well as models trained on BioGPT (a domain trained Generative Pre-trained Transformer). To further demonstrate the utility, a case study was performed using bacterial association network data obtained from experimental studies. CONCLUSION: This study attempts to demonstrate the applicability of transfer learning in a niche field of life sciences where understanding of inter bacterial relationships is crucial to obtain meaningful insights in comprehending microbial community structures across different ecosystems. The study further discusses how such a model can be further improved by fine tuning using limited training data. The results presented and the datasets made available are expected to be a valuable addition in the field of medical informatics and bioinformatics.

OHDSI Standardized Vocabularies-a large-scale centralized reference ontology for international data harmonization.

IMPORTANCE: The Observational Health Data Sciences and Informatics (OHDSI) is the largest distributed data network in the world encompassing more than 331 data sources with 2.1 billion patient records across 34 countries. It enables large-scale observational research through standardizing the data into a common data model (CDM) (Observational Medical Outcomes Partnership [OMOP] CDM) and requires a comprehensive, efficient, and reliable ontology system to support data harmonization. MATERIALS AND METHODS: We created the OHDSI Standardized Vocabularies-a common reference ontology mandatory to all data sites in the network. It comprises imported and de novo-generated ontologies containing concepts and relationships between them, and the praxis of converting the source data to the OMOP CDM based on these. It enables harmonization through assigned domains according to clinical categories, comprehensive coverage of entities within each domain, support for commonly used international coding schemes, and standardization of semantically equivalent concepts. RESULTS: The OHDSI Standardized Vocabularies comprise over 10 million concepts from 136 vocabularies. They are used by hundreds of groups and several large data networks. More than 8600 users have performed 50 000 downloads of the system. This open-source resource has proven to address an impediment of large-scale observational research-the dependence on the context of source data representation. With that, it has enabled efficient phenotyping, covariate construction, patient-level prediction, population-level estimation, and standard reporting. DISCUSSION AND CONCLUSION: OHDSI has made available a comprehensive, open vocabulary system that is unmatched in its ability to support global observational research. We encourage researchers to exploit it and contribute their use cases to this dynamic resource.

Katherine P. Andriole - A trailblazer in medical informatics and radiology.

In a traditionally male-dominated field, the journey of Dr. Andriole represents a pioneering path in the realms of radiology and medical imaging informatics. Her career has not only reshaped the landscape of radiology but also championed diversity, equity, and inclusion in healthcare technology. Through a comprehensive exploration of Dr. Andriole's career trajectory, we navigate her transition from analog to digital radiology, her influential role in pioneering picture archiving communication systems (PACS), and her dedication to mentorship and education in the field. Dr. Andriole's journey underscores the growing influence of women in radiology and informatics, exemplified by her Gold Medal accolades from esteemed organizations. Dr. Andriole's career serves as a beacon for aspiring radiologists and informaticians, emphasizing the significance of passion, mentorship, and collaborative teamwork in advancing the fields of radiology and informatics.

Structure and Funding of Clinical Informatics Fellowships: A National Survey of Program Directors.

BACKGROUND: In 2011, the American Board of Medical Specialties established clinical informatics (CI) as a subspecialty in medicine, jointly administered by the American Board of Pathology and the American Board of Preventive Medicine. Subsequently, many institutions created CI fellowship training programs to meet the growing need for informaticists. Although many programs share similar features, there is considerable variation in program funding and administrative structures. OBJECTIVES: The aim of our study was to characterize CI fellowship program features, including governance structures, funding sources, and expenses. METHODS: We created a cross-sectional online REDCap survey with 44 items requesting information on program administration, fellows, administrative support, funding sources, and expenses. We surveyed program directors of programs accredited by the Accreditation Council for Graduate Medical Education between 2014 and 2021. RESULTS: We invited 54 program directors, of which 41 (76%) completed the survey. The average administrative support received was $27,732/year. Most programs (85.4%) were accredited to have two or more fellows per year. Programs were administratively housed under six departments: Internal Medicine (17; 41.5%), Pediatrics (7; 17.1%), Pathology (6; 14.6%), Family Medicine (6; 14.6%), Emergency Medicine (4; 9.8%), and Anesthesiology (1; 2.4%). Funding sources for CI fellowship program directors included: hospital or health systems (28.3%), clinical departments (28.3%), graduate medical education office (13.2%), biomedical informatics department (9.4%), hospital information technology (9.4%), research and grants (7.5%), and other sources (3.8%) that included philanthropy and external entities. CONCLUSION: CI fellowships have been established in leading academic and community health care systems across the country. Due to their unique training requirements, these programs require significant resources for education, administration, and recruitment. There continues to be considerable heterogeneity in funding models between programs. Our survey findings reinforce the need for reformed federal funding models for informatics practice and training.